Clinical Outcomes of Standardized Central Venous Catheterization Simulation Training: A Comparative Analysis.

OBJECTIVE: A standardized ultrasound-guided Internal Jugular Central Venous Catheterization (US-IJCVC) using online- and simulation-based training was first designed and then large-scale deployed at a teaching hospital institution to improve CVC surgical education. To understand the impact that the standardized training might have on patient complications, this study focuses on identifying the impact of the integration of an iteratively designed US-IJCVC training on clinical complications at a teaching hospital. DESIGN AND PARTICIPANTS: A comparative study was conducted using TriNetX, a global health research network. Using Current Procedural Terminology (CPT) codes and the International Statistical Classification of Diseases and Related Health Problems (ICD-10) codes, we identified the total number of patients with a CVC and mechanical, infectious, and thrombosis complications with and without billable ultrasound between July 1 to June 30 in 2016, 2017, and 2022. SETTING: A teaching hospital institution in Pennsylvania. RESULTS: Results showed a correlation between years and complications indicating, (1) mechanical complications billable ultrasound, (2) infectious complications billable ultrasound, and (3) thrombosis complications billable ultrasound were significantly lower with the large-scale deployment. Results also showed that (4) mechanical, infectious, and thrombosis complications with and without billable ultrasound are within the range that prior work has reported. CONCLUSION: These results indicate that there has been a decrease in mechanical, infectious, and thrombosis complications, which correlates with the US-IJCVC training large-scale deployment.

Interrater agreement between student and teacher assessments of endotracheal intubation skills in a self-directed simulation learning environment.

BACKGROUND: Practical skill assessment is an important part of the learning process to confirm competencies in acquired medical knowledge. OBJECTIVE: This study aimed to compare the assessments of endotracheal intubation skills using the HybridLab® methodology between students and teacher in terms of interobserver reliability. METHODS: Reliability analysis was performed with observational data (data are reported according to STROBE guidelines). The study was conducted in two countries, the Lithuanian University of Health Science (LUHS) and Pennsylvania State University (PSU) in the US, between 1 January and 30 June 2020. A total of 92 students (60 from LUHS and 32 from PSU) were trained in endotracheal intubation using an algorithm-driven hybrid learning method. At the end of the training session, the participants had to complete the evaluation scenario, which was assessed by one of the students and evaluated remotely by a single teacher. The student assessment of the endotracheal intubation procedure was compared with the teacher's assessment using correlation and estimation of the intraclass correlation coefficient. RESULTS: Overall, the medians of the student and teacher assessments were both 100% (0%). Spearman's correlation coefficient between the student and teacher assessments was 0.879 (p = 0.001). The intraclass correlation coefficient used for interobserver variations between the students and teacher was 0.883 (95% confidence interval from 0.824 to 0.923). CONCLUSIONS: The algorithm-driven hybrid learning method allows students to reliably assess endotracheal intubation skills to a level comparable with that of the teacher's evaluation. This learning method has the potential to be a cost-effective and efficient way to provide high-quality education while also saving human resources.

Percutaneous endoscopic gastrostomy in amyotrophic lateral sclerosis: outcomes of a dedicated anesthesia and surgery protocol.

BACKGROUND: Patients requiring percutaneous endoscopic gastrostomy (PEG) for amyotrophic lateral sclerosis (ALS) related dysphagia represent a clinical challenge. Diminished pulmonary function and aspiration risks can lead to anesthesia-related complications, and gastric displacement from hemidiaphragm elevation may preclude safe gastric access. This study reports the efficacy and outcomes of a dedicated anesthesia/surgery management protocol for ALS patients undergoing PEG. METHODS: In 2013, a PEG placement protocol for ALS patients was developed emphasizing efficient pre-operative evaluation, rapidly metabolized anesthetic agents, and minimization of opioid use. Outcomes were analyzed retrospectively. Preoperative weight loss, pulmonary function tests, total analgesia, procedural time, and 90-day morbidity and mortality were recorded. RESULTS: From 2013-2019, 67 ALS patients (mean age 65.3 years, 52.2% female) received a PEG under the protocol. Mean percentage weight loss 6 months before PEG was 9.3 ± 5.1% with 38.8% of patients meeting criteria for severe malnutrition. Mean anesthesia time (propofol induction to anesthesia emergence) was 34.5 ± 10.8 min and mean operative time (endoscope insertion to dressing placement) was 16.4 ± 8.2 min. Regional anesthesia with liposomal bupivacaine was performed in 76.1%. All attempts at PEG placement were successful. With a mean follow-up of 6.1 ± 6.8 months, all PEGs were functional and there were no surgical site complications. Thirty-day readmission rate was 7.0% and 90-day mortality was 22.4% (46.7% occurring within 30 days). Mean time from surgery to death was 8.8 ± 7.8 months. CONCLUSIONS: Protocols for optimizing PEG may help overcome challenges present in the ALS patient population. Despite patient comorbidities, protocol implementation and dedicated team members resulted in a high procedural success rate and low complication rate. Further study is warranted to optimize the timing of PEG placement in relation to ALS disease progression and determine the utility of regional anesthesia during PEG placement.

Diagnosis and Treatment of New-Onset Perioperative Atrial Fibrillation.

This article reviews medical and surgical risk factors for developing atrial fibrillation (AF), the most common sustained dysrhythmia in the United States. Evidence for assessment and management of patients with AF, including AF newly identified in the preoperative clinic, immediately preoperatively, intraoperatively, and unstable AF, is presented. A stepwise approach to guide anesthetic decision-making in the assessment of newly identified preoperative AF is proposed. Anesthetic considerations, including the potential impacts of anesthetic and vasopressor selection, and current evidence related to rate control and rhythm control via pharmacologic or electrical cardioversion as well as anticoagulation strategies are discussed.

Evaluating the Impact of Assessment Metrics for Simulated Central Venous Catheterization Training.

INTRODUCTION: Performance assessment and feedback are critical factors in successful medical simulation-based training. The Dynamic Haptic Robotic Trainer (DHRT) allows residents to practice ultrasound-guided needle insertions during simulated central venous catheterization (CVC) procedures while providing detailed feedback and assessment. A study was performed to examine the effectiveness of the DHRT in training the important skills of needle tip tracking and aspiration and how these skills impact procedural complications in simulated CVC. METHODS: The DHRT data were collected for 163 residents at 2 hospitals for 6 simulated needle insertions. Users were given automated feedback on 5 performance metrics, which measure aspiration rate, arterial punctures, punctures through and through the vein, loss of access to the vein, and successful access to the vein. Aspiration rates and tip tracking rates were analyzed to determine their significance in preventing CVC complications and improving performance. RESULTS: Tip tracking rates higher than 40% were 2.3 times more likely to result in successful venous access than rates less than 10%. Similarly, aspiration rates higher than 80% were 2.6 times more likely to result in successful venous access than rates less than 10%. Proper tip tracking and aspiration both reduced mechanical complications. Resident performance improved for all metrics except tip tracking. CONCLUSIONS: Proper tip tracking and aspiration both reduced complications and increased the likelihood of success. However, the skill of tip tracking was not effectively learned through practice without feedback. Therefore, ultrasound-guided needle-based procedures, including CVC, can be improved by providing specific feedback to users on their ultrasound usage to track needle insertions.

Impact of the COVID-19 pandemic on American College of Surgeons-Accredited Education Institutes & American Society of Anesthesiologists-Simulation Education Network: Opportunities for interdisciplinary collaboration.

BACKGROUND: The COVID-19 pandemic presented challenges for simulation programs including American College of Surgeons Accredited Education Institutes and American Society of Anesthesiologists Simulation Education Network. American College of Surgeons Accredited Education Institutes and American Society of Anesthesiologists Simulation Education Network leadership were surveyed to identify opportunities to enhance patient safety through simulation. METHODS: Between January and June 2021, surveys consisting of 3 targeted domains: (I) Changing practice; (II) Contributions and recognition; and (III) Moving ahead were distributed to 100 American College of Surgeons Accredited Education Institutes and 54 American Society of Anesthesiologists Simulation Education Network centers. Responses were combined and percent frequencies reported. RESULTS: Ninety-six respondents, representing 51 (51%) American College of Surgeons Accredited Education Institutes, 17 (31.5%) American Society of Anesthesiologists Simulation Education Network, and 28 dually accredited centers, completed the survey. Change of practice. Although 20.3% of centers stayed fully operational at the COVID-19 onset, 82% of all centers closed: 32% were closed less than 3 months, 28% were closed 3 to 6 months, 8% were closed 7 to 9 months, and 32% remained closed as of June 6, 2021. Most impacted activities were large-group instruction and team training. Sixty-nine percent of programs converted in-person to virtual programs. Contributions. The top reported innovative contributions included policies (80%), curricula (80%), and scholarly work (74%), Moving ahead. The respondents' top concerns were returning to high-quality training to best address learners' deficiencies and re-engagement of re-directed training programs. When asked "How the American College of Surgeons/American Society of Anesthesiologists Programs could best assist your simulation center goals?" the top responses were "facilitate collaboration" and "publish best practices from this work." CONCLUSION: The Pandemic presented multiple challenges and opportunities for simulation centers. Opportunities included collaboration between American College of Surgeons Accredited Education Institutes and the American Society of Anesthesiologists Simulation Education Network to identify best practices and resources needed to enhance patient safety through simulation.

A novel algorithm-driven hybrid simulation learning method to improve acquisition of endotracheal intubation skills: a randomized controlled study.

BACKGROUND: Simulation-based training is a clinical skill learning method that can replicate real-life situations in an interactive manner. In our study, we compared a novel hybrid learning method with conventional simulation learning in the teaching of endotracheal intubation. METHODS: One hundred medical students and residents were randomly divided into two groups and were taught endotracheal intubation. The first group of subjects (control group) studied in the conventional way via lectures and classic simulation-based training sessions. The second group (experimental group) used the hybrid learning method where the teaching process consisted of distance learning and small group peer-to-peer simulation training sessions with remote supervision by the instructors. After the teaching process, endotracheal intubation (ETI) procedures were performed on real patients under the supervision of an anesthesiologist in an operating theater. Each step of the procedure was evaluated by a standardized assessment form (checklist) for both groups. RESULTS: Thirty-four subjects constituted the control group and 43 were in the experimental group. The hybrid group (88%) showed significantly better ETI performance in the operating theater compared with the control group (52%). Further, all hybrid group subjects (100%) followed the correct sequence of actions, while in the control group only 32% followed proper sequencing. CONCLUSIONS: We conclude that our novel algorithm-driven hybrid simulation learning method improves acquisition of endotracheal intubation with a high degree of acceptability and satisfaction by the learners' as compared with classic simulation-based training.

Going the (social) distance: Comparing the effectiveness of online versus in-person Internal Jugular Central Venous Catheterization procedural training.

BACKGROUND: This study compares surgical residents' knowledge acquisition of ultrasound-guided Internal Jugular Central Venous Catheterization (US-IJCVC) between in-person and online procedural training cohorts before receiving independent in-person Dynamic Haptic Robotic Simulation training. METHODS: Three surgical residency procedural training cohorts, two in-person (N = 26) and one online (N = 14), were compared based on their performance on a 24-item US-IJCVC evaluation checklist completed by an expert physician completed after training. Pre- and post-training US-IJCVC knowledge was also compared for the online cohort. RESULTS: No significant change in the pass rates on the US-IJCVC checklist was found between in-person and online cohorts (p = 0.208). There were differences in the Economy of Time and Motion between in-person and online cohorts (p < 0.005). The online cohort had significant increases in US-IJCVC knowledge pre-to post-training (p < 0.008). CONCLUSION: Online training with independent simulation practice was as effective as in-person training for US-IJCVC.

Reliability of simulation-based assessment for practicing physicians: performance is context-specific.

INTRODUCTION: Even physicians who routinely work in complex, dynamic practices may be unprepared to optimally manage challenging critical events. High-fidelity simulation can realistically mimic critical clinically relevant events, however the reliability and validity of simulation-based assessment scores for practicing physicians has not been established. METHODS: Standardised complex simulation scenarios were developed and administered to board-certified, practicing anesthesiologists who volunteered to participate in an assessment study during formative maintenance of certification activities. A subset of the study population agreed to participate as the primary responder in a second scenario for this study. The physicians were assessed independently by trained raters on both teamwork/behavioural and technical performance measures. Analysis using Generalisability and Decision studies were completed for the two scenarios with two raters. RESULTS: The behavioural score was not more reliable than the technical score. With two raters > 20 scenarios would be required to achieve a reliability estimate of 0.7. Increasing the number of raters for a given scenario would have little effect on reliability. CONCLUSIONS: The performance of practicing physicians on simulated critical events may be highly context-specific. Realistic simulation-based assessment for practicing physicians is resource-intensive and may be best-suited for individualized formative feedback. More importantly, aggregate data from a population of participants may have an even higher impact if used to identify skill or knowledge gaps to be addressed by training programs and inform continuing education improvements across the profession.

OBJECTIVE ASSESSMENT METRICS FOR CENTRAL LINE SIMULATORS: AN EXPLORATION OF CAUSAL FACTORS.

The Dynamic Haptic Robotic Trainer (DHRT) was developed to minimize the up to 39% of adverse effects experienced by patients during Central Venous Catheterization (CVC) by standardizing CVC training, and provide automated assessments of performance. Specifically, this system was developed to replace manikin trainers that only simulate one patient anatomy and require a trained preceptor to evaluate the trainees' performance. While the DHRT system provides automated feedback, the utility of this system with real-world scenarios and expertise has yet to be thoroughly investigated. Thus, the current study was developed to determine the validity of the current objective assessment metrics incorporated in the DHRT system through expert interviews. The main findings from this study are that experts do agree on perceptions of patient case difficulty, and that characterizations of patient case difficulty is based on anatomical characteristics, multiple needle insertions, and prior catheterization.

Acute Adrenal Insufficiency in the Perioperative Period: A Case Report.

Acute adrenal insufficiency is a rare but potentially life-threatening event during the perioperative period. The usual manifestations of an acute adrenal crisis can mimic common postoperative complications and a high index of suspicion is required for the diagnosis. Early diagnosis and prompt treatment can be lifesaving. We present the case of a 65-year-old man who, after a partial nephrectomy, developed acute adrenal insufficiency, which remained undiagnosed in the postoperative period, eventually leading to cardiac arrest. This case highlights the need for perioperative physicians to have a watchful eye for diagnosing and treating this uncommon yet lethal condition.

Resuscitation Education Science: Educational Strategies to Improve Outcomes From Cardiac Arrest: A Scientific Statement From the American Heart Association.

The formula for survival in resuscitation describes educational efficiency and local implementation as key determinants in survival after cardiac arrest. Current educational offerings in the form of standardized online and face-to-face courses are falling short, with providers demonstrating a decay of skills over time. This translates to suboptimal clinical care and poor survival outcomes from cardiac arrest. In many institutions, guidelines taught in courses are not thoughtfully implemented in the clinical environment. A current synthesis of the evidence supporting best educational and knowledge translation strategies in resuscitation is lacking. In this American Heart Association scientific statement, we provide a review of the literature describing key elements of educational efficiency and local implementation, including mastery learning and deliberate practice, spaced practice, contextual learning, feedback and debriefing, assessment, innovative educational strategies, faculty development, and knowledge translation and implementation. For each topic, we provide suggestions for improving provider performance that may ultimately optimize patient outcomes from cardiac arrest.

Developing and validating a simple and cost-effective strabismus surgery simulator.

PURPOSE: To demonstrate that a nonbiologic strabismus surgery simulator is not inferior to a biologic wet lab for teaching the key steps of strabismus surgery. METHODS: A total of 41 medical students were randomly assigned to one of two groups: biologic wet lab or nonbiologic simulator. The students trained according to the group's protocol then participated in a recorded final assessment using a realistic strabismus surgery model. Two independent reviewers, masked to training method, graded the video recordings using three scoring systems: the International Council of Ophthalmology Approved-Ophthalmology Surgical Competency Assessment Rubric for Strabismus Surgery (ICO-OSCAR), the Global Rating Scale of Objective Structured Assessment of Technical Skills (OSATS), and the Alphabetic Summary Scale (ASS). RESULTS: The primary endpoint, total ICO-OSCAR score, was 36.7 ± 2.2 for the wet lab group and 36.0 ± 2.7 for the nonbiologic group (difference in means, -0.7; one-sided 95% CI, -2.0, ∞). The lower bound of the one-sided 95% confidence interval for the difference in mean scores was -2.0, which was greater than the a priori noninferiority margin of -5.0 points. The secondary outcome measure, mean total OSATS score and ASS score, revealed no statistical significant differences between training methods (P = 0.73 and P = 0.44, resp.). CONCLUSIONS: The simple, nonbiologic strabismus surgery simulator is not inferior to the biologic wet lab with respect to total ICO-OSCAR score. It is a portable, inexpensive, and effective training tool for novice surgeons.

Simulation-based Assessment of the Management of Critical Events by Board-certified Anesthesiologists.

BACKGROUND: We sought to determine whether mannequin-based simulation can reliably characterize how board-certified anesthesiologists manage simulated medical emergencies. Our primary focus was to identify gaps in performance and to establish psychometric properties of the assessment methods. METHODS: A total of 263 consenting board-certified anesthesiologists participating in existing simulation-based maintenance of certification courses at one of eight simulation centers were video recorded performing simulated emergency scenarios. Each participated in two 20-min, standardized, high-fidelity simulated medical crisis scenarios, once each as primary anesthesiologist and first responder. Via a Delphi technique, an independent panel of expert anesthesiologists identified critical performance elements for each scenario. Trained, blinded anesthesiologists rated video recordings using standardized rating tools. Measures included the percentage of critical performance elements observed and holistic (one to nine ordinal scale) ratings of participant's technical and nontechnical performance. Raters also judged whether the performance was at a level expected of a board-certified anesthesiologist. RESULTS: Rater reliability for most measures was good. In 284 simulated emergencies, participants were rated as successfully completing 81% (interquartile range, 75 to 90%) of the critical performance elements. The median rating of both technical and nontechnical holistic performance was five, distributed across the nine-point scale. Approximately one-quarter of participants received low holistic ratings (i.e., three or less). Higher-rated performances were associated with younger age but not with previous simulation experience or other individual characteristics. Calling for help was associated with better individual and team performance. CONCLUSIONS: Standardized simulation-based assessment identified performance gaps informing opportunities for improvement. If a substantial proportion of experienced anesthesiologists struggle with managing medical emergencies, continuing medical education activities should be reevaluated.

A Taxonomy of Delivery and Documentation Deviations During Delivery of High-Fidelity Simulations.

INTRODUCTION: We developed a taxonomy of simulation delivery and documentation deviations noted during a multicenter, high-fidelity simulation trial that was conducted to assess practicing physicians' performance. Eight simulation centers sought to implement standardized scenarios over 2 years. Rules, guidelines, and detailed scenario scripts were established to facilitate reproducible scenario delivery; however, pilot trials revealed deviations from those rubrics. A taxonomy with hierarchically arranged terms that define a lack of standardization of simulation scenario delivery was then created to aid educators and researchers in assessing and describing their ability to reproducibly conduct simulations. METHODS: Thirty-six types of delivery or documentation deviations were identified from the scenario scripts and study rules. Using a Delphi technique and open card sorting, simulation experts formulated a taxonomy of high-fidelity simulation execution and documentation deviations. The taxonomy was iteratively refined and then tested by 2 investigators not involved with its development. RESULTS: The taxonomy has 2 main classes, simulation center deviation and participant deviation, which are further subdivided into as many as 6 subclasses. Inter-rater classification agreement using the taxonomy was 74% or greater for each of the 7 levels of its hierarchy. Cohen kappa calculations confirmed substantial agreement beyond that expected by chance. All deviations were classified within the taxonomy. CONCLUSIONS: This is a useful taxonomy that standardizes terms for simulation delivery and documentation deviations, facilitates quality assurance in scenario delivery, and enables quantification of the impact of deviations upon simulation-based performance assessment.